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Abstract 

In this work we focus on a natural class of population protocols whose dynamics are 
modelled by the discrete version of Lotka-Volterra equations. In such protocols, when an 
agent a of type (species) i interacts with an agent b of type (species) j with a as the initiator, 
then b’s type becomes i with probability Pij. In such an interaction, we think of a as the 
predator, b as the prey, and the type of the prey is either converted to that of the predator 
or stays as is. Such protocols capture the dynamics of some opinion spreading models and 
generalize the well-known Rock-Paper-Scissors discrete dynamics. We consider the pairwise 
interactions among agents that are scheduled uniformly at random. 

We start by considering the convergence time and show that any Lotka-Volterra-type 
protocol on an n-agent population converges to some absorbing state in time polynomial in 
n, w.h.p., when any pair of agents is allowed to interact. By contrast, when the interaction 
graph is a star, even the Rock-Paper-Scissors protocol requires exponential time to converge. 
We then study threshold effects exhibited by Lotka-Volterra-type protocols with 3 and more 
species under interactions between any pair of agents. We start by presenting a simple 
4-type protocol in which the probability difference of reaching the two possible absorbing 
states is strongly amplified by the ratio of the initial populations of the two other types, 
which are transient, but “control” convergence. We then prove that the Rock-Paper-Scissors 
protocol reaches each of its three possible absorbing states with almost equal probability, 
starting from any configuration satisfying some sub-linear lower bound on the initial size of 
each species. That is, Rock-Paper-Scissors is a realization of a “coin-flip consensus” in a 
distributed system. Some of our techniques may be of independent value. 


1 Introduction 

Population protocols are a recent model of computation that captures the way in which the 
complex behavior of systems (biological, sensor nets, etc.) emerges from the underlying local 
interactions of agents. Agents are modeled as anonymous automata with a finite number of 
states, and interactions (changes of state) occur between randomly chosen pairs of agents under 
some fixed set of local rules. The interaction follows from the mobility of agents in the popula¬ 
tion, as in the case of birds flying past each other in a flock in the setting originally described 
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Figure 1: Examples of objective functions for opinion spreading: probability p that a given 
type becomes dominant in the population as a function of the fraction r of its supporters in the 
initial population. 

by Angluin et al. lam. More generally, we can model agents as nodes of an interaction graph 
G, and assume interactions take place along the edges of this graph. 

Population protocols provide a way of describing dynamical effects which may occur in a 
population. For example, one can imagine that members of a population can be either healthy or 
infected, and whenever two individuals meet, if one is infected, then the other one also becomes 
infected. Thus the interesting question becomes: how fast can the infection spread? Quite 
naturally, population protocols are also used to model opinion spread in populations under 
interactions. An interaction between a pair of agents, one holding opinion A and the other 
opinion B, results in a possible change of opinion by one of the interacting agents. Such local 
interactions result in a change over time of the relative sizes of the options holding opinions A 
and B. Eventually, the population protocol may lead the system to converge to a state in which 
one type, A or B, becomes dominant in the population. The probability of convergence to a 
given dominant type may potentially depend on the initial state of the population in different 
ways, e.g., exhibiting linear behavior, or transitions at one or more thresholds (cf. Fig. [^. In 
fact, the ability of population protocols to converge to an opinion presented by at least some 
threshold ratio of the population (e.g., a majority) lies at the heart of their study (cf. [SI El]). 

In this work, we focus on a natural scenario of interactions modeled by the discrete version 
of Lotka-Volterra equations, with the goal of better understanding their applicability in the 
computational framework of opinion spreading and voting protocols. In their original form, the 
(continuous) Lotka-Volterra differential equation were initially applied in the modeling of peri¬ 
odic chemical reactions and also in the predator-prey dynamics of fish in the Adriatic Sea m 
p.ll], and are perhaps best known for their connection to replicator dynamics and to evolving 
strategies in game theory USEli- In discrete Lotka-Volterra-type (LV-type) population proto¬ 
cols, during an interaction, the initiating agent (holding some state A) tries to impose its state 
on the other agent (holding some other state B) and succeeds with some probability Pab- The 
LV-type protocol on k states is fully characterized by its k x k probability matrix P. LV-type 
interactions are natural both in the context of predator-prey protocols, in that they correspond 
to a possible expansion of the predating (initiating) agent into the ecological niche of its prey, 
and in opinion propagation, in that they do not allow a new derived state C to be created as 
a result of an interaction. Unlike their continuous variant, discrete LV-type protocols always 
converge to an absorbing state in which no further state changes occur. We study the time 
until such convergence happens in general, and look at the probability of achieving different 
absorbing states depending on the initial distribution of states in the population for specific 
protocols. 
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1.1 Our Results 


We start by proving in Sectionj^a general convergence result: any LV-type protocol on a n-agent 
population converges to some absorbing state in time 0{poly{n)), w.h.p., under the model of 
uniformly random interactions between agents (i.e., when the interaction graph is the complete 
graph G = K^)- Whereas studies of the behavior of the continuous LV dynamics under artificial 
stochastic noise of the random walk type have been performed for some particular dynamics in 
the statistical physics community (cf. [ 23 | for a survey), this is, to the best of our knowledge, 
the first mathematically rigorous study of the impact of finite populations on the behavior 
of the dynamics, and the first one to present results which hold for an arbitrary probability 
matrix P of the protocol. Our proof takes advantage of the structure of the replicator dynamics 
corresponding to the continuous Lotka-Volterra equations, which admit either stationary orbits 
in the state space or have a repeller, depending on the parameters of the protocol. 

By contrast, we also show in Sectionthat introducing an interaction constraint can severely 
impact the convergence time for LV-type protocol. We consider a specific LV-type protocol 
known as rock-paper-scissors (RPS), in which each of the three types overcomes exactly one 
other type in cyclic manner, and show that RPS requires exponential time to converge to an 
absorbing state when the interaction graph is a star (G = iLi,n)- 

Next, we look at the applicability of LV-type protocols in the context of their threshold 
behavior in voting problems which require a consensus of opinion. For the case of 2 types, the 
only unbiased LV-type protocol encompasses the so-called “game of life and death” between 
the 2 types, converging to a given absorbing state with probability proportional to its initial 
representation in the population (regardless of the interaction graph G). We show, however, 
that for 3 and more types, threshold effects become apparent even under uniform interactions 
{G = Kn)- We start by proposing in Section]^ a simple 4-type majority-type protocol, in which 
the probability difference of reaching the two absorbing types is amplified with respect to the 
ratio of the initial populations of the two other states. We close the paper by exhibiting in 
Section for the before-mentioned RPS protocol a completely different type of threshold effect 
in the small population region. We prove that RPS reaches each of its three absorbing types 
with almost equal probability (l/3±o(l)), starting from any configuration satisfying some sub- 
linear lower bound on the sizes of the three types. Our proof proceeds by a Martingale-type 
analysis, which may be of independent interest, and takes into account the symmetries of the 
state space of the protocol. We can thus view the RPS protocol as an embodiment of the 
“coin-flip consensus” illustrated in Fig. [^c): any opinion with non-negligible representation in 
the population, even a minority one, has an equal chance of success in the opinion-spreading 
process. To the best of our knowledge, this is the first population protocol with polynomial-time 
convergence for which such a property has been identified. 

1.2 Related Work 

Population Protocols and Majority Computation. The population protocol model of 
Angluin et al. mm captures random interactions between finite-state agents, motivated by 
applications in sensor mobility. Despite the limited computational capabilities of individual 
sensors, such protocols permit at least (depending on available extensions to the model) the 
computation of two important classes of functions: threshold predicates, which decide if the 
weighted average of types appearing in the population exceeds a certain value, and modulo 
remainders of similar weighted averages. With respect to threshold behavior, a major problem 
is the design of majority protocols, which consist in obtaining convergence of all agents of the 
population to a type initially represented by the majority of agents. Such a protocol, converging 
to a population of a single type, was first proposed in [3] . Given the complete interaction graph. 
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the type reached by the protocol is the initial majority type, w.h.p., provided that the initial 
difference between the majority and minority type is UJ{^/nlogn) for a n-agent population. This 
protocol relies on 3 types, two of which represent the original types present in the population, 
while the third is a transient type representing a blank opinion. A 4-state protocol for finding a 
majority is presented in [5], based on a different principle of “leader” and “follower” agents, and 
achieves similar performance guarantees. By contrast, [20] presented the first protocol which 
converges to the initial majority type with probability 1, even when the difference between types 
in the original population is constant. This protocol makes use of 4 states and finds a majority in 
expected polynomial time, even in the case when interactions are not spread uniformly over the 
population, but restricted to a connected subgraph of agent pairs. (We remark that none of the 
mentioned majority protocols belongs to the LV-type considered in this paper, in particular, 
due to the creation of transient states which do not exist in the initial population.) Other 
applications and models of population protocols are surveyed in mini El]. 

Spreading of opinion and voting. The spread of trust and opinion in a social network was 
one of the original motivations for the study of population protocols mi Problems in which a 
set of nodes has to converge to a consensus decision chosen from a candidate set of values pro¬ 
posed by the participating nodes, are also of fundamental importance in distributed computing, 
in tasks such as serialization of database operations or leader election m- Models of voting 
processes, which solve such questions, involve the propagation of opinion through multiple push- 
or pull-operations between pairs of agents, usually performed in parallel throughout the system. 
From the perspective of security and simplicity of design, a desirable property of the protocols is 
that at any time during the execution, the state of the node should describe its current opinion, 
belonging to the set of opinions initially represented in the population. Under this constraint, 
given a set of only 2 initial opinions, it is impossible to obtain convergence to the majority 
opinion w.h.p. of correctness in the standard model of voting (cf. e.g. [8|). However, majority 
voting can be achieved in many graph classes by extensions of the population protocol frame¬ 
work, allowing simultaneous interactions between more than 2 nodes. Specifically, protocols in 
which a node polls a constant number k of randomly chosen neighbors in the interaction graph 
and changes its opinion as the majority opinion in the chosen neighborhood set, have been 
considered in the literature. The number of required interactions until convergence is achieved 
is shown to be 0(n log n) for the complete interaction graph (both under sequential and parallel 
pull actions of nodes [6l[9|), 0(n log n) for random regular interaction graphs when k = 2 (under 
parallel pull actions of nodes 0) and 0(n log log n) for Erdos-Renyi random interaction graphs 
when k = 5 (under additional constraints on the initial placement of opinions [T|). Our work is 
also related to the voting model of DeGroot [TO] , in which opinions spread through the network 
due to weighted interactions between agents. However, the DeGroot model associates weights 
of influence with particular agents, rather than with the opinions they hold, and consequently 
the obtained equations for propagation of opinion are inherently linear. 

Discrete Lotka-Volterra dynamics and cyclic games. The continuous Lotka-Volterra 
dynamics, first defined in [19], give rise to several discrete variants of so-called predator-prey 
models of interaction in a population, which differ essentially in the way the population size is 
maintained after the prey is attacked by the predator. Such models studied in the literature 
include the discrete May-Leonard model, in which the attacked agent (prey) disappears from 
the system, leaving behind a special state representing an empty niche, which can be later filled 
by another species, as well as the LV-type discrete dynamics studied in this work, in which the 
niche left by the prey is immediately filled by the species of the predator (cf. [24] for further 
generalizations of the framework). The LV-type model is particularly worthy of study due to 
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its transient stability in a setting in which several species are in a cyclic predator-prey relation. 
Cyclic LV-type protocols have been consequently identified as a potential mechanism for de¬ 
scribing and maintaining biodiversity, e.g., in bacterial colonies [mile]. Cycles of length 3, in 
which type 1 attacks type 2, type 2 attacks type 3, and type 3 attacks type 1, form the basis of 
the best-known protocol, called rock-paper-scissors (RPS). The transient properties of RPS and 
related protocols, describing in particular the time until the system collapses to an absorbing 
state, have been studied in the statistical physics literature using a variety of experimental and 
analytical techniques (mostly based on approximation with physical equations), under various 
scheduler models: the standard model of sequentially occurring random interactions, models 
with 0(n) parallel encounters, models in which the discrete process is described by adding 
stochastic noise to a continuous-time process, etc. The original analytical estimation method 
applied to RPS was based on approximation with the Fokker-Planck equation [23]. A subse¬ 
quent analysis of cyclic 3- and 4-species models using Khasminskii stochastic averaging can be 
found in m, together with a general discussion of the classification of dynamics according to 
convergence speed. A mean field approximation-based analysis of RPS was performed in |22| . 
All of these results provide a qualitative understanding of cyclic protocols, and at a quanti¬ 
tative level, provide evidence that the RPS protocol reaches an absorbing state after roughly 
O(n^) interactions. Finally, we remark that in a computer science setting, |7] made the connec¬ 
tion between the Lotka-Volterra equations and (computational) population protocols, defining 
the class of so-called Linear Viral Protocols, in which the capacity of agents to participate in 
interactions changes over time. 

1.3 Model and Preliminaries 

We consider population protocols in the following setting. The population V with k types 
(species) is a set of n agents, with each agent v G V assigned a state variable s, whose value at 
time t is denoted st{v) G {1, ... ,k} = [k], describing its current type. The elements of V are 
connected into an (undirected, connected) interaction graph G = {V,E). Agents assigned to 
type i at time t, 1 < i < k, are called the population of type i at time t. 

The population protocol P is a probability distribution over [k]'^, taking values in In 
an execution of protocol P, at each time step t = 1, 2, 3,..., a scheduler daemon picks a pair 
of interacting agents u,v G V such that {u,v) G E u.a.r., and updates the state variables of 
these agents, sampling the pair (st+i(u), st+i(u)) according to the distribution P{st{u), st{v)). 
We will say that the population protocol is of the Lotka-Volterra type (LV-type for short) if 
the state of the initiating agent (the predator) never changes during an interaction, and the 
state of the other agent (the prey) either remains unchanged or changes to that of the initiator, 
i.e., for any transition which occurs with non-zero probability, we have st+i{u) = st{u) and 
st+i(u) G {st(u),st(u)}. 

For i G [k] and a fixed execution of protocol P, we will denote the size of the Lth population 
as ni{t) = \{v G V : st(v) = i}|, and its relative size as Xi(t) = ni(t)/n. The set of states of all n 
agents at time t is referred to as the state or configuration of the system. When the interaction 
graph is the complete graph Kn, then we identify the state of the system with the vector x{t). 
For G = Kn, the protocol P defines a Markov chain on the set X of possible states x{t). We 
note that in this case, the size of the state space can be trivially bounded as 0{n^), i.e., is 
polynomial in n for any fixed protocol. 

In the sequel, any LV-type protocol P will be identified with its k x k probability matrix 
P, such that for an interaction {u,v), we have st+i(u) = st{u) with probability Pst{u),st{v)i a-ncl 
st+i(u) = st{v) with probability 1 — Pst{u),st{v)- (Informally, we may write: “ij —)■ ii with 
probability Pij” ■) In general, matrix P need not be skew-symmetric nor stochastic. We only 
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assume that Pa = 0, for 1 < i < k, and that every type interacts in some way with at least one 
other type (for every i, I < i < k, there exists j, 1 < i < k, such that Pij > 0 or Pji > 0). We 
will denote the value of the minimal non-zero entry of matrix P as -Pmin- For every LV-type 
protocol, we construct the corresponding digraph D{P), whose vertex set is the set of types [k], 
and an arc {i,j) exists if Pij > 0. We call the dynamics irreducible if the digraph D{P) has 
no sources (i.e., there are no types without a predator, so each column of matrix P has at least 
one non-zero entry) and is connected. 

We remark that as n —)• oo, our random process converges to its (deterministic) limit con¬ 
tinuous dynamics, given by the following set of first-order differential equations (a special case 
of the continuous Lotka-Volterra equations): 


dxi{t) 

dt 


k 


— Xi{t) {{Pjj Pji)Xj{t)\i 
i=i 


for 1 < f < /c. 


( 1 ) 


The above dynamics is non-linear and exhibits non-trivial properties in terms of limit behavior 
and stability measures such as the Lyapunov exponent (cf. [H]). Our discrete population case 
with finite n can be informally seen as a special form of “noise” introduced into the Lotka- 
Volterra equation Q. 

In this paper, we also give our attention to two specific LV-type protocols: 

• Rock-Paper-Scissors (RPS) is the LV-type protocol with k = 3 types (denoted 1,2,3), 
whose probability matrix P has the following non-zero entries: P 12 = P 23 = P 31 = 1- 

• Wolves-and-Sheep (WS) is the LV-type protocol with /c = 4 types (denoted X,Y,x,y), 
whose probability matrix P has the following non-zero entries: PxY = Pxx = Pyx = 
Pyy = 1, Pxy = Pyx = 1/2. 

Throughout the paper, we use the term “with very high probability” (w.v.h.p.) to denote 
events occurring with probability at least 1 — and the term “with high probability” 

(w.h.p.) for events occurring with probability at least 1 — Thus, polynomially (resp., 

logarithmically) many events which individually hold w.v.h.p. (w.h.p.) also hold jointly w.v.h.p. 
(w.h.p.) by virtue of the union bound. In time and distance analysis, we will use the notation O 
and n to conceal poly-logarithmic factors { 0 {f) = C)(/polylog(n)), n(/) = n(//polylog(n))). 


2 Convergence of Discrete LV-type Protocols 

For any LV-type protocol, there exists a subset Xg C V of stationary absorbing states, which 
remain unchanged under transformation P (for any x G Xg, applying any transformation gov¬ 
erned by protocol P to x preserves x). Note that for any state x G X \ Xg, there exists an 
execution of the system which reaches some absorbing state in a finite number of steps with 
strictly positive probability. 

2.1 Bound on Convergence Time under Complete Interactions 

We start by showing that any LV-type protocol on a population of size n converges to an 
absorbing state in time 0{poly{n)), when there are no population constraints (the interaction 
graph is Kn). 

Theorem 2.1 (LV-type convergence for complete interactions). For any probability matrix P, 
there exists a constant c such that the LV-type protocol defined by P converges for the complete 
interaction graph to an absorbing state in 0{n^) steps, w.v.h.p. 
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Before proceeding with the proof, we introduce some auxiliary notation. For a fixed matrix 
P, we define the skew-symmetric nett interaction matrix A A = P — . Observe that 

Aij = Pij — Pj 

form: 

dxi 

— = Xi{AiX), 


V ~ equation Q describing the continuous dynamics now takes the simpler 


( 2 ) 


or in vector notation: 


dx , . , 

-=i-G{.4x), 


where we treat x as a column vector, and Ai is the i-th row vector of matrix A, and 0 denotes 
the element-by-element product of two column vectors (cf. |14l Chapter 7] for a more detailed 
exposition of the properties of this continuous dynamics). 

For a fixed real vector b G R^, which we will appropriately choose later, we define the 
potential P of a system state x as (compare [HI equation (5.3)]): 


U{x) = bi Inxj 

i=l 


and by U{t) we will mean U{x{t)). Observe that under evolution of the system given by the 
continuous dynamics Q, we have: 


dU 

dt 


i=l 


1 dxi 
Xi dt 


k k / / k 

'^bi{Aix) = X] ( ( 


V 


Xj = P Ax. 


2=1 


^ 2=1 


We define vector b as follows: 

(i) if there exists a non-zero vector 6 > 0, such that A = 0, choose b as any such vector 
with ||6||oo = 1. 


(ii) otherwise, choose b as any vector satisfying b"’"A > 0, with 


= 1 . 


The completeness of the above definition follows from a basic theorem of linear optimiza¬ 
tion, known as the “no arbitrage theorem” in financial mathematics (cf. also 1141 proof of 
Thm. 5.2.1] JJ 


Proof of Theorem 2.1. Observe that by the definition of the LV-type process, if a certain type i 
has been eliminated by time t (xj(t) = 0), then it will never reappear (xi^r) = 0, for all t >t). 
We will now show that the number of non-zero values of Xj, 1 < z < /c, is reduced by at least 
one within a polynomial number of steps, w.h.p. Note that this is sufficient to obtain the claim 
of the theorem, since we may iterate the argument, each time restricting the definition of the 
dynamics and the matrix A to those of the k types which are non-empty. In the rest of the 
proof, we will be assuming w.l.o.g. that Xj > 0, for all i. We will also be assuming that the 
dynamics is irreducible; otherwise, if digraph D{P) is disconnected, we can consider each of the 
weakly connected components separately, and if any of the weakly connected components has 
a source, then one can easily show that all the prey of this source is eliminated in a polynomial 
number of steps. 


^For completeness, we provide a short version of the argument. If (i) does not hold, then the non-negative 
cone R>o intersects with the kernel ker only at point 0. It follows that there must exist a strictly positive 
vector h G R* orthogonal to the kernel, h _L ker(A^). Since the orthogonal complement of ker(A^) is the colnmn 
space of matrix A, which is equal to the row space of A (since A = —AT), the equation A — h admits a solution 
b, and it is possible to satisfy condition (ii). 
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The main part of the proof is contained in the following claim. 

Claim. For any irreducible LV-type protocol, there exists a constant such that for any 

n > 0, for any initialization of the protocol with n agents, w.v.h.p. there exists a time step 
T £ 0(poly(n)) in which ni{T) < rimin; for some type i, 1 < i < k. 

Proof (of claim). For any t > 0, we consider the random variable 5 representing the change 
of the value of the potential function U between time steps t and t + 1: 

6it) = U{t + l)-Uit). (3) 


We start by remarking that in a single time step, the change of potential is restricted to a 
single interaction between some pair {i,j), and thus bounded by the following expression when 
ni > nmin, for all 1 < z < /c: 


< max 


An^) 

+ bj (In 


\ n 

n ) 

' V 

<2 max 

In(nj) - ln(nj 

-1)|< 

4 




^min 


n,- — 1 , Uj 

— -In — 


n 


n 


< 


(4) 


Since the probability of the interaction of the form {i,j) in the {t + l)-st step is and 
this interaction increases n* by 1 and decreases Uj by 1 with probability Pij, the expectation 
E5(t) takes the form: 


Ui + l 


n 


— In — ) + 6,- ( In 
n 


n, — 1 


— In 


n 


n, 


n 


= EE «>('>•('" 

i=i j=i ^ 

k k 

biHiUj {Pij (ln(ni + 1) - In(ni)) + Pji (ln(nj - 1) - In(ni))). 

i=l j=l 

We now introduce the following notation for Taylor series remainders in the expansion with 
respect to 1/x: ln(x + 1) -ln(x) = y - ^(1- and ln(x) - ln(x - 1) = 4 + ^(1 + ^^^), 

where 0 < r~^{x) <2/3 and 0 < r~{x) < 2/3, for every x > 1. Next, we obtain after elementary 
transformations: 


1 




1 


k k 


EEm.. 


i=i j=i 


i=i j=i 


r+(ni) 


m 


+ Pji 1 1 + 


r (m) 


m 


k k 




2n- i i ^ 


r^im 


+ Pji 1 1 + 


r {m) 


(5) 

\ zr;.» \ \ \ / / / 

i=l j=l 

We now use ([^ to bound the expectation E(5(t) depending on whether condition (i) or (ii) 
is satisfied by vector b. 


• Case (i): Let > 0 for all 1 < i < /c, b'^A = 0, and = 1 for some a, 1 < a < k. We 
have hAijUj = 0. Consequently, assuming n* > 2, for all 1 < z < A:, we may 

write: 


1=1 j=i 


r+{ni) 


m 


+ Pji 1 1 + 


r {ui) 


m 


(6) 


- X] X] - 2>n^ria ^ “ 


i=l j=l 


i=i 


3n^ 
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In the above transformations, we took into account the fact that all bi are non-negative, 
that 0 < r~^{rii), r~ (m) < 2/3 for m > 1, and that by convention, the nonnegative-valued 
matrix P has a non-zero entry in every row or corresponding column. 

We now define a random variable given as d'{t) = 5(f) -|- in every step of the 

process where n* > 2, for all 1 < z < /c, and set 6'{t) = 0 for all other steps of the process. 
Clearly, Xt = ^ super-martingale in f, satisfying the bound \Xt — W-i| < 

|5(f)| < 2 by (g. By Azuma’s inequality, Pr[W < ^t] > 1 - exp 


6n2 


1 — 0{e ”), for any sufficiently large value of f = Observe, however, that the events 

“5'(r) = 5(r) -|- for all r < f” and “W < cannot hold simultaneously, since 

otherwise we have C/(0) — U{t -|- 1) = — Xt > = 0(n^). On the other hand, 

Xi > 1/n and so every potential U{t) satisfies: 

\U{t)\ < k\nn = C>(lnn), 

hence such a potential difference is impossible. It follows that the probability that we 
have Hi < 1, for some 1 < i < /c, for all except at most 0(n^) steps of the process, is 
1 - 0{e-^). 


Case (ii); Let h = A, with hi > /imin > 0 for all 1 < z < A:, and let 
n-i > zzmin = max|2, t^|, for 1 < z < fe, we now have: 


= 1. Assuming 


E4(*) = ^ E 


i=l 




Pa 1 - 


'(rii) 



^ni - 


E 

i=i 


2?Zm 



m 


'-mm 

n 


+ Pji I 1 + 


r (rii)' 


m 


1 - 


4A: 


3zZrnin^: 


mm "-mm 


> 


Similarly as in the case of condition (i), we define a random variable 6'{t), given as 
5'{t) = 5{t) — in every step of the process where n* > for all 1 < z < fe, and set 

6'{t) = 0 for all other steps of the process. This time, Xt = X]t=o ^ sub-martingale 

in f, satisfying the bound \Xt — Xt-i\ < 15(f)I < by ddl). Applying Azuma’s inequality 

once again, we obtain Pv[Xt > —> 1 — exp — 

for a sufficiently large value of f = 0(n^). By a similar potential difference argument as 
before, we obtain that the event zzj < rimin, for some 1 < z < A:, occurs within the first 
Q{v?) steps with probability 1 — C>(e“"'). 


2(4/4iJt 


= I - 0(e-^), 


This completes the proof of the claim. 

To obtain the claim of the theorem, we now need to notice that whenever the population 
of some type drops below a constant threshold zzmim the probability that the population is 
eliminated completely within the next 0(1) steps of the irreducible protocol is polynomially 
large in n. Indeed, suppose we have nj(f) < zzmin- Then, by the irreducibility of the protocol, 
there must exist an active predator j of type z, 1 < j < k, with Pji > Pmin and rij > 1 by 
assumption. The probability that species z is eliminated in the next ni(t) steps can be lower- 
bounded by the probability of the occurrence of elimination of a representative of population z 
by a representative of population j in each of those steps, (fi^)"'min = 1/C)(n^"^™'"). Overall, 
after at most occurrences of the event “there exists 1 < z < A: such that rz, < 

each of which takes place every polynomial number of steps w.v.h.p. by the Claim, one of the 
species will have been eliminated completely w.v.h.p., which gives the claim of the theorem. □ 
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We remark that the key property of LV-type protocols (i.e., that prey is changed to the 
same type as the predator) is essential in guaranteeing the polynomial time of reaching an 
absorbing state. For example, consider the following (non-LV) population protocol on 3 types 
a,6, and c: {ah —>■ ac,ac —)> aa,ca —)• cb,ba —)• bb,bb —)• ba}, where all the transitions occur 

with probability 1. This protocol always preserves the type of the predator, but sometimes 
sets the third type as the type of the prey. For this protocol, for any initialization such that 
?^a(0) = Q{n),nb{0) = n(n), the expected time to reach an absorbing state is exponential in n. 


2.2 Rock-Paper-Scissors with the Star Interaction Graph 

It turns out that for LV-type protocols, the convergence time may become exponential when the 
interaction graph is not complete. Whereas all LV-type protocols with 2 species (e.g., the game 
of life-and-death [T3]) converge in polynomial time to an absorbing state for any interaction 
graph, this is no longer trne when the number of species is at least 3. We observe this for the 
rock-paper-scissors (RPS) protocol on the star. 


Definition 2.1. The Rock-Paper-Scissors (RPS) protocol is the LV-type protocol with k = 3 

r 0 1 0 

populations, given by the following matrix: P = 0 0 1 

[ 1 0 0 

Theorem 2.2 (RPS convergence on the star). The RPS protoeol with a iLi,n interaetion graph, 
initialized so that initially each type has at least Umin > n/3—n/200 agents, reaches the absorbing 
state in expected time Tabs > . 


Proof. In this section we will fix G = (V, E) as a star on n -|- 1 vertices, or equivalently full 
bipartite graph Ki^n'- V = {0,1,..., n}, i? = {(0,1), (0, 2),..., (0, n)}. Full state of the system 
is encoded by a quadruple St = (st( 0 ),ni(t),n 2 (t),n 3 (t)) (for clarity of notation, we do not 
count the state of a middle vertex towards any of ni{t)). 

Thus, the transition probabilities of system are given as follow (assuming st(0) = 1 w.l.o.g.): 


St+i =(si+i(0), ni(f -h l),n2{t + 1), n3(t -b 1)) = 


= 


(I,ni(t),n2(t),n3(t)) 

(l,ni(t) -b l,n 2 (t) - l,n 3 (t)) 
(3,ni(t),n2(t),n3(t)) 


with probability 
with probability 
with probability 


We define a sequence of timesteps of RPS process, that marks changes of st{0). More 
specifically, we define a sequence of timesteps, where to = 0, and tj+i is the smallest value 
larger than L snch that Si.^^(O) / sq(0). 

Let us denote by dft) = nmax(i) — ^min(^) the difference between largest and smallest of the 
population. We denote the potential U{t) = ni{t)n 2 {t)n 3 {t). 

Let T be an arbitrary timestep such that 17(T) < 0.037025-n^, while 17(T—1) > 0.037025-n^. 
Since 


min (1/3 -b x)(l/3 - 1/200 - x/2)(l/3 - 1/200 -b x/2) > 0.037025 

a:e[-l/300,1/300] 

then d{T) > n/100. 

Let AT = re/1000. Thns, for any t £ [T, T -b AT], d{t) £ iggo^]- Thus we denote 

ti = T < < ... < tj+Ai < T -b AT. 
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With probability at least (1 — we have tj+i — tj < 'nP'^. Thus below we assume this 

bound on length of this gap, and at the end of this analysis we will have to acknowledge the 
failure probability of . 

Thus, Ai > n^'®. Let us take arbitrary tj such that T < tj < < T + AT. W.l.o.g. we 

can assume that Stj = 1. Denote Ai = tj^i — tj, A 2 = tj +2 — tj+i and A 3 = tj+ 3 . Thus, the 
state at fj+s fulfills: 

{ni{tj+ 3 ),n 2 {tj+s),n 3 {tj+ 3 )) = {ni{tj),n 2 {tj),n 3 {tj)) + (Ai - A 2 , A 3 - Ai, A 2 - A 3 ), 
where: 

E(A3|S,,| = 

Ai, A 2 , A 3 G [1 - O(n-0-®), 1 + 0(n-®-®)] 

We can bound the expected potential change: 

B[U{tj+3) - U{tj)\St^] = X2ni{tjf - \3n2{tj)n3{tj) + X3n3{tjf- (7) 

- Xini{tj)n 2 {tj) + Xin 2 {tjf‘ - X 2 ni{tj)n 3 {tj) + R{tj) 


where 


R{tj) = ni(t,)E[(A3 - Ai)(A 2 - A3)|5t,] + n 2 (t,)E[(Ai - A 2 )(A 2 - A3)|5t,]+ 

+ n3(t,-)E[(Ai - A2)(A3 - Ai)\St,] + E[(Ai - A2)(A3 - Ai)(A2 - A3)|5t,] 

and satisfies 

\R{t,)\=0{n). 

Lemma 2.3. 

E[U{t,+3) - U{tj)\St^] > - O(n- 0 '®)) 

Proof. Let us denote: u = {X 2 ni{tj), Xin 2 {tj), X 3 n 3 {tj)), v = {ni{tj),n 2 {tj),n 3 {tj)), w = 
{n3{tj),ni{tj),n2{tj)). 

We can rewrite Q to: 

E[U{tj+ 3 ) - U{tj)\St^] =uo{v-w) + R{tj). 

We denote /(ft, v) = e, ^{v — w,v) = a and /(u — w,u) = a'. 

Observe, that \u — v\ < 0{n~^'^)\v\. Thus, from sin(e) < we have £ = C>(n“®'®). 

Observe, that |i;| = |u;| and that \v — w\ = &{d{tj)), thus 

1 ^ \v — w\ 

cosa = sinf-Zfu, re)) = 1 / 2 ^—— = 0 ( 1 ) 

2 |u| 

Thus, since: 

vo{v-w) = ^i{ni{tj) -n 2 {tj)f + {n 2 {tj) - n 3 {tj)f + {n 3 {tj) -ni{tj))^), 
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we can bound: 


j I u\ cos (y! 

uo (v — w) = Ittlln — n;| cos a' = (v o (v — w))-rz;r - > 

PI cos a 

> — 0{n~^'^)){cose — tanasine) = 

2 cos a 2 

= \d{tjf(l - 0(n-»»))(l - 0(n-»>)" - e(l) . 0(n-»’)) = - 0(n-»-»)) 

which, since R{tj) = 0{n), gives the desired claim. □ 

We also observe following bound on potential change: 

\Uitj+ 3 ) - U{tj)\ < 3 • n°-^ • 0{n) ■ 0{n) = 0{n^-^) 


We define a following submartingale: 


W(z) = U{t3i) -i-y • (1 - °'®)) 


(being submartingale follows from application of Lemma 2.3 and observation that d{tj) > 
By application of Azuma’s inequality: 


1 _ e(n“'“) „ „ 

P(W(0) - Wi-Ai)) > 0(n2-^'5)) < e ) 

3 


which is equivalent to saying, that w.v.h.p.: 


U{tAi) > U{to) - + Ai • 0(n2)(l - 0{n-^-^)) > [/(to). 

Thus, taking into account original probability of failure, we get a following: for any 

timestep T such that U{T) falls below particular threshold, there exists w.v.h.p. a timestep 
T' > T such that U{T') > U{T). Thus the expected time to reach the absorbing state (which 
requires [/ = 0) is at least . □ 


3 The Wolves-and-Sheep (WS) Protocol 


In this section, we investigate the dynamics of the Wolves-and-Sheep LV-type protocol, aiming 
at replicating dynamics of infection spreading for two different infections and two types of partial 
immunity to infections. 


Definition 3.1. The Wolves-and-Sheep (WS) protocol is the LV-type protocol with k 

0 1 


= 4 


populations (denoted X,Y,x,y), given by the following matrix: P = 


1 5 ^ 


1 

0 

0 


1 


1 
2 

0 0 
0 0 


In the considered setting, initially almost all the population consists of types x and y (sus¬ 
ceptible agents known as “sheep”). A constant number of infected agents of types X and Y (the 
“wolves”) are introduced into the population. Following the definition of the protocol, a wolf 
acting as a predator infects a sheep of a type denoted by the same lower-case with probability 
1, and a sheep of the opposite lower-case type with smaller probability (1/2). Thus, in the 
protocol, population x of sheep has affinity towards X (or resistance for Y), and population y 
has affinity towards Y (or resistance for A). 


12 









A real-world setting for such a protocol is the following. Initially, a population of users 
has smartphones of two different manufacturers (say, xPhones and yPhones). Simultaneously, 
each of the manufacturers introduces a new smartphone model into the market. Upon meet¬ 
ing someone with a new phone, a user will be convinced to upgrade to this model with some 
probability, which is higher if they are already a user of the older product of the same manufac¬ 
turer. How will the balance of market share of the two manufacturers change after the whole 
market has adopted the new phone? It turns out that the market share of the new products 
grows exponentially in time, until almost all users have upgraded. However, the growth rate for 
the manufacturer with the initially (slightly) larger market share is larger, hence eventually, it 
dominates almost all of the market. 

We note that in the definition of the WS protocol, we also add some random drift between 
the species X and Y, which does not affect the nature of the process, but allows us to achieve 
an absorbing state in which eventually only the dominant type is represented. 

Theorem 3.1 (majority amplihcation by WS). Let nx(0) = 1, nv(0) = 1, na;(0) = 0(n) and 
ny{0) = Q{n), such that = 3 ^ for some absolute constant e > 0. Then the system reaches 
the absorbing state with only population X, w.h.p. 

Proof. We will divide the analysis into three consecutive phases. 

Phase I. In the first steps of the process, we experience rather random behavior due to the 
small populations of the wolves. Whereas we would like to show that nx{t) nyit), this may 
initially not be the case; after cn steps, for c <C log n, with probability roughly e~^ we still have 
n-xit) = 1) while nyit) satisfies exponential growth and in expectation we have Eny(t) = 
However, we can bound this behavior, showing that at some time tj = 0(nlogn), population 
X has grown to nx{tf) = n(logn), while nyitf) is bounded by a small polynomial of n, w.h.p. 

Specifically, in Phase I we run the process for / = log 2 (alnn) — 4 iterations, with the i-th 
iteration, i = 1,2,...,/ starting at time U_i and ending at time U (we assume to = 0). The 
duration of the i-th iteration is dti = ti — U_i = ^ time steps, with a = O.Ole. 

We start by upper-bounding the size of population ny{tf) at the end of the phase; note that 
tf < 2an\nn. We can trivially dominate the growth process for ny{t) by a simpler unbounded 

growth process ny(t) given by the dependence: n'y (t-|-l) = ny(t)-|-l with probability and 
n'yit -|- 1) = n'y(t), otherwise. For any ci log 2 n < s < log 2 n — 1, where ci > 0 is an arbitrarily 
small positive absolute constant, by an application of Chernoff bounds for the negative binomial 
distribution, we can lower-bound the length of the time interval during which n'y grows from 
2^ to 2^^^ as at least n/4, with probability 1 — Thus, we have at time tf. 

ny{tf) < n'y{tf) < 2^=1 

w.h.p, for a suitably chosen value of ci. Likewise, we can show that nx{t) < and ny{t) < 
^lOo £qj. ^ w.h.p. 

Next, conditioned on the above events, we lower-bound the size of nx{tf), considering the 
value nx{U) at the end of each iteration. Note that the probability of an interaction between 
an individual from X and an individual from Y during Phase I can be upper-bounded as 

thus we can assume that no such interaction occurs during Phase 
I, w.h.p. We now prove by induction that in each of the / iterations of the phase, the value of 
nx increases by a multiplicative factor of 2, w.h.p. By the inductive assumption, fix 1 < i < / 
and let nx(U-i) > 2 *“^. Since we have throughout the i-th iteration that nx{t) < and 
ny{t) < it follows that nx{t) + ny{t) > 1 — Thus, process nx during our i-th 

iteration dominates the growth process n'^, such that nx(U-i) = 2 *“^ and nx{t+Yj = nx{t) + l 
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with probability and n'xit + 1) = n'xit), otherwise. Once again, applying the Chernoff 
bound for the negative binomial distribution, we can upper-bound w.h.p. the length of the time 
interval r* during which n'x grows from 2 *“^ to 2 * as: 

4n , , , i ,• 1 ,, (Scolnlnn (Sco-|-Q;/2)nlnn anlnn 

n < ^(C 2 Inn + 2(2* - 2*-i)) = -+ 8n < ^= 5U, 

where the first inequality holds with probability 1 — n^^^) for any arbitrarily small absolute 
constant C 2 > 0, and the last inequality holds when we choose C 2 < a/16. In this way, we 
have obtained the inductive claim, and overall, we have nx{tf) >2-^ > ^Inn, w.h.p. By an 
analogous analysis, we obtain nyitf) > 2 -^ > ^ Inn, w.h.p. 


Phase II. In the second phase, we start with populations of wolves ^ Inn < nx{tf) < n^^°‘ 
and ^Inn < nyitf) < n^^“. We will show that both populations now experience exponential 
growth, but with a larger growth rate for population X. By the time the total population of 
wolves has grown to a level of 0 (n/logn), we have that nx asymptotically outgrows ny. 

Let T be the first time step such that at least one of the populations of wolves exceeds the 
threshold i.e., nxiT) = or ny(T) = Starting from time step tf, we will divide 

time into intervals of duration /3n, where /? > 0 is a sufficiently small positive constant (we put 
/3 = jfg). We will now obtain w.h.p. bounds on the growth rate of the two processes during each 
such time interval, until time T. (Since the population of wolves treated as a whole undergoes 
exponential growth, we have T = O(nlogn) w.h.p., thus we will need to perform union bounds 
on only a small number of events associated with the O(logn) time intervals until time T.) 

Now, fix a time interval It = [t,t + lln\, for tf < t < T. Within this interval, we construct an 
undirected graph Gt = {V, Et), where V is the population, and Et is the set of all pairs of agents 
{i, j}, such that there exists an interaction between i and j during interval It- We observe that 
Gt ~ G'{n,m) where G'{n,m) is a variant of the Erdos-Renyi random graph model where we 
choose m = j3n edges uniformly at random, discarding repeated edges. This corresponds to an 
average edge density of approximately For i > 1, let E = S <2 U 5 > 2 , where S <2 and US '>2 
are subsets of agents belonging to connected components of Gt having at most 2 vertices and 
more than 2 vertices, respectively. By performing a random graph analysis, we have w.h.p.: 


|S<2l>(l-o(l))| (1-^ 


n—1 


2/3 


n + 2^ 1 - ^ 


n 


2(3 


n 


2n—3 


> 


>(1 — 2(3)n + 2/3n(l — 4(3) >n — 8(3‘^n. 


Thus, we have |S'> 2 | < 8(3‘^n, w.h.p. Denoting by y >2 = 5'>2 n y(t), by independence of choice 
of sets 5>2 and Y{t) and a simple Chernoff bound, we obtain |T> 2 | < 16/3^ny(t), w.h.p. We 
will upper bound the size of set T(t + (3n) as follows: 


nyit + (3n) < ny{t) + Ay[t,t + (3n] + |T> 2 |, 


where Ay[t,t + (3n] is the number of individuals which joined T as a result of interactions 
having individuals from set Y (t) as the initiator in the time interval [t, t + (3n]. The number of 
considered interactions can be upper-bounded as {1+C3)(3ny{t), for an arbitrarily small positive 
constant C 3 > 0, w.h.p. In each interaction involving an element of set T(t), the current size 
of Y increases by I if the interaction involves an element from y, and remains unchanged 
otherwise. We can thus upper-bound the value Ay[t,t -|- (3n\ through stochastic domination, 
running a process Y' for (I -|- C3)(3ny{t) steps, starting from T/ = 0 and increasing W by I with 
probability py in each step, where: 


Py 






e 

2 ' 
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Applying another simple Chernoff bound, we eventually obtain w.h.p.: 


Ay[t, t + j3n] <(1 + C3)l3nY{t) ■ (1 + C 3 )py < 

<(1 + 3 c 3 ) - 0 /3ny(t) < Pnrit), 

for sufficiently small choice of constant C 3 . Overall, we have w.h.p. 

ny(t + /3n) < (1 + - I + 16/3^ nyit) < (^1 + /3^ ny(t). ( 8 ) 


Now, we lower-bound the rate of growth of nx in the time interval [t,t + (3n]. Since we have 
ny < throughout the considered interval, the number of interactions in the time interval 
[t^t + I3n] having an element from X{t) as the prey can be upper-bounded as Cilnn, w.h.p., for 
an arbitrarily small positive constant C 4 > 0. We denote by X*{t) the subsect of individuals 
from X{t) which do not become prey during the considered time interval; we have |A*(t)| > 
nx{t) — C 4 Inn > (1 — ^^)nx{t), for a suitable choice of constant C 4 . Now, we lower-bound the 
number of interactions involving an individual from X* as the initiator during the time interval 
[t,t + /3n] as (1 — C5)/3X*{t), w.h.p., for an arbitrarily small constant C 5 > 0. Since we have 
nx > (1 -|-e) § — and Uy > (1 — e) | throughout the considered Phase II of the process, 

it follows that the probability of increasing nx by 1 in a step in which an element from X* is 
the initiator is at least: 


Px 


1 2\1/1 2\3e 3 

2 ^ log n) 2 \2 ^ log n) “ 4 2 logn' 


Overall, we get that the number of new elements joining X in time interval [t, t + (3n] is at 
least (1 — cq)P (I -|- 1 ) X*{t), w.h.p., for an arbitrarily small positive constant cg > 0. Of these 
elements, we likewise have that (an arbitrarily small) constant proportion will be lost due to 
interactions initiated by Y within the interval [t,t + f3n], whereas the remaining ones will belong 
to X{t + I3n). Overall, we obtain w.h.p.: 


nx{t + /3n) > X*{t) + (1 - cj)P + 0 X*{t) > 

(1 + (1 - c,)i3 (5 + 0 ) (1 - 1 ^) „yt) > (1 + (? + 1 ) li'j „yt) ( 9 ) 


for some suitable choice of arbitrarily small positive constant cy > 0 and of C 4 . 

Equations Q and Q provide a separation of the growth rates of processes X and Y. 
Observe, that for small enough /3, we have (since < 1 + |e): 

nx{t + Pn) ^ / ny{t + Pn) y^X 

nx{t) ~ V ny{t) ) 

Thus, we eventually obtain at the end of Phase II, w.h.p.: nx{T) = ny{T) = 

^(j.^0.l£+l/(l+2/3£)) _ 0(74!“'^^) for s < 1 . 


Phase III. We are now in a situation that, w.h.p., in some timestep Tq, nx(To) > 
ny{To) = for some constant \ < n < 1. We can safely assume, that ny{To) = 0(n^), 

since by a simple coupling argument, swapping some of x and y for Y cannot help with reaching 
absorbing state of only X. 

We will analyse the speed of growth of both nx{t) and ny(t). 
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Claim 3.2. There is increasing sequence of steps Tq, Ti, T 2 , ■ ■ ■ ,Tj such that Tj is the first ele¬ 
ment of this sequence satisfying nx{Tj) -\-ny{Tj) < such that, w.h.p.: — ( nx(ro) ) ’ 

and that nx{Ti) = 0 (nx(Jo)). 

Proof We proceed by induction on i: 

We assume we have a moment Tj > Tq. From the inductive assumption: nyiTi) = 
0(ny(ro)) = 0(n'^), and that nx{Ti) + ny{Ti) = We pick as Tj+i a timestep such 

that in timesteps {Tj,..., Tj+i} there are ny (Tj)) events of X or T attacking x or y. 

Since nx{t) + ny{f) > at each step with probability at least — o(l))n“^/'^ there is 

attack of X or y on x or y. Thus, by Chernoff bound, following is w.h.p.: 

Tj+i - Tj = W/V(Tj) 

Thus, the attacks of X on T and of T on X (a random walk, so to speak) accounts, w.h.p., 
for a change of population in the timesteps Tj,..., Tj_|_i (denoted as Aj): 

Aj < (Tj+i - Tj)2/3 = 0(n" • n^/^)2/3 = o(n") = o(ny(Tj)) 


Observe that for any Tj < t < Tj+i: 


ny(t) < 2ny(Tj) + Aj < 2.01ny(Tj), 


ny(t) > ny(Tj) - Aj > 0.99ny(Tj), 
nx{t) < nx{Ti) + ny(Tj) + Aj < l.Olnx(Tj), 
nx{t) > nx{Ti) - Aj > 0.99nx(Tj). 


Thus, if in the timestep t one of the members of populations x or y is drawn as a second 
participant and one of A or T is drawn as a first participant, we have increase in population of 
X with probability at least (1 — pj)/2 and increase in population of Y with probability at most 
Pi, for 


. < 

“ nx{t) + ny(t) 


< 2.03 • 


ny(Tj) 
nx{Ti)' 


So, by Chernoff bound, we have, w.h.p: 


ny (Tj+i) < ny (Tj) + ny (Tj) • 1.1 • pj + Aj < ny (Tj) • (1 + 3 


ny(Tj) 

nx(Tj) 


( 10 ) 


nx{Ti+i) > 
> 


nx{Ti) - Aj + ny (Tj) • 0.9 • (1 - pi)/2 > 


nx{Ti) ■ 



1 nyiTj) 
3 nx(Ti) 


ny 


(TiV 


nx(Ti} I 


From the inductive assumption: 


nyiTj) 

nx{Ti) 




Thus, we observe that (by (0 and ([l2|)): 


nx(T.+i)>nx(T.).(l + l^J^) 


( 11 ) 


( 12 ) 
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and using (10); 


nx{Ti+i) 

nx{Ti) 


12 


nviTi+i) 

nriTi) 


< 


which completes the inductive proof of claim. 

Thus, we can now complete the proof of main theorem. By Lemma |3.2[ at moment Tj we 
will have following: nx{Tj) = 0(n), nyiTj) = 0{n^ ■ (logn)^^), nx{Tj) + ny{Tj) = 

At this moment, we can as well assume that all of x and y becomes T, giving us a win for X 

in following life-death game of wolves with probability at least 1- ^ ^ —, which holds 

w.h.p. □ 


4 The Rock-Paper-Scissors (RPS) Protocol 

In this section, our goal is to show that the RPS protocol reaches each of absorbing states 
with almost equal probability, given that the initial population of each species is linear (or 
slightly sub-linear) in n. We recall that the probability matrix of the RPS protocol is given 





0 

1 

-1 ■ 

by Definition 

2.1 

The corresponding matrix A is the following: A = 

-1 

1 

0 

-1 

1 

0 


RPS protocol admits a cyclic symmetry of behavior with respect to its species. For each of the 
species a G {1, 2, 3}, the relative change Axa in population of this species in the given step can 
be expressed as: 




- • Aua 
n 


+l/n, with probability XaXa+i, 

< — 1/n, with probability Xa+ 2 Xa-, 

0, otherwise. 


(13) 


where the population of at most one species changes in every step. The indices of populations 
are always 1,2, or 3, and other values should be treated as mod 3, in the given range. We 
also introduce the continuous dynamics x{t) corresponding to the RPS process, given for each 
species by the differential equation: 


dxg 

dt 


-^{Xa+l-Xa+2), 

n 


(14) 


which corresponds precisely to the continuous dynamics ([^, up to an additional time-scaling 
factor of n introduced for easier comparison with the discrete process. In all further considera¬ 
tions, we set the potential U used in the analysis as: 


3 

U{x) = ^In Xi = ln(xiX2X3). 
^=1 


Lines U = const correspond to orbits in the continuous setting (14). 


,- 0.002 


Theorem 4.1 (coin-flip consensus property of RPS). For any state x such that Xg > n~ 
for all a G {1, 2, 3}, the probability of the system reaching any one of its three possible absorbing 
states I ± 


The rest of this section is devoted to the proof of Theorem |4.1[ The proof of the theorem 
relies on the observation that the discrete RPS protocol approximately follows the limit cycle 
(orbit) of its continuous version. More precisely, we will observe that for an appropriately 
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chosen starting state x( 0 ) = (xi,X 2 ,X 3 ) of the system, there is a time moment t (corresponding 
to an approximate traversal of 1/3 of the limit cycle) for which the state is given as x{t) = 
(x 3 + Ax 3 ,xi + Axi,X 2 + AX 2 ), with Axi sufficiently small. We will then use this to observe 
that if the probability of reaching any fixed absorbing state i from state {xi,X 2 ,X 3 ) is p and 
of reaching absorbing state i from state (xi + Axi,X 2 + Ax 2 ,a ;3 + Axs) is then by cyclic 
symmetry of populations, the probability of reaching state {i + 1) mod 3 from state x{t) is also 
PA- If p ~ PA, then state x(0) leads to absorbing states i and (i + l)mod3 with almost the 
same probability. 

At an intuitive level, the main arguments of the proof are the following. To show that the 
probability of reaching an absorbing states are almost the same for points x( 0 ) = (xi, X 2 , X 3 ) and 
y(0) = {x 3 , xi, X 2 ), we perform a coupling of walks starting from x(0) and y(0). Here, coupling 
of Markovian processes is understood in the usual sense (cf. e.g.[T 8 ]), though it is worth noting 
that since we are interested only in reaching an absorbing state (and not measuring the number 
of steps after which such a state is reached), we can in some steps of the coupling decide to 
delay one of the walks, allowing the other to run, provided that each of the processes remains 
unbiased. For simplicity, suppose that a walk x is located at a point at which all populations 
are of linear size in N and the difference in size between the largest and smallest population is 
also linear in n (e.g., U{x) = —20.) The behavior of the (undelayed) walk x under our evolution 
in the next t steps (for t sufficiently small with respect to n) can be seen as a superposition of 
three types of motion: 


1 . 


Propagation along the trajectory U{x) 


evolution of the continuous process (14). 
step is 0 (l/n), or Q(t/n) over t steps. 


const at a speed approximately given by the 
The Euclidean distance traversed in a single 


2. Random drift along the trajectory U{x) = const (slowing or accelerating with respect to 
the average speed). Over a short interval time of length t, this drift shifts the point by 
±0{\/i/n) along its trajectory. 


3. 


Random drift orthogonal to the trajectory U{x) = const. Over a short interval time of 
length t, this drift shifts the potential U of the point by AO{y/t/n). 


The analysis of the process is somewhat technical, since the two types of random drift have 
slightly biased averages (in particular, in Section 2.1 we took advantage of the fact that the 
orthogonal drift has an outward bias over very long intervals of time), the probabilities of 
different moves are changing over time, and the motion in different directions is not independent. 
The drift and the propagation speed also depend on the relation between the maximum and 
minimum of the sizes of the three populations, which change in time. Nevertheless, the random 
drifts of our process behaves closely enough to a combination of independent random walks 
that we can deal with them with a martingale-type analysis. We present the necessary tools in 
Subsection 4.1 formulating them so that the claims hold even when the smallest population is 
sublinear. After that, in Subsection |4.2| we formalize our coupling framework and perform the 


claimed coupling of the points x and y (Lemma 4.8). 


4.1 Technical lemmas 

To begin with, we recall the following simple property of a simple random walk on a line: a 
walk starting from point 0 and proceeding for T steps is confined to an interval of the form 
[—C>(\/T), ©(-v/T)] w.v.h.p, but is likely to hit all points at a distance of o(\/T) from 0. By a 
Doob martingale analysis, we state a generalization of this property applicable to a wider class 
of processes (to the best of our knowledge requiring weaker assumptions than those in bounds 
given in the literature). 
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Lemma 4.2 (concentration and anti-concentration). Let e > 0 be an absolute eonstant. For 
t = 1,... ,T, let X{t) = X]t=i ® random process which satisfies the following condition 

for some non-negative parameters c, a, a: If |X(t — 1)| < cVt^^ + otT, then: 

(i) 5{t) is a bounded random variable, regardless of the history of the process: 

|(5(t) I S{t - 1), 5(t - 2 ),..., 5(0)1 < c, 

(a) The expectation of 5{f) is bounded, regardless of the history of the process: 

|E(5(t)|5(t-l),5(t-2),...,5(0))| <«, 

(Hi) The standard deviation of 6{t) is lower-bounded, regardless of the history of the process: 

|Var(5(t)|5(t-l),5(t-2),...,5(0))| >^2. 

Then: 

• (Concentration bound) With probability at least 1 — we have: 

l^(t)l < + aT. (15) 

• (Anti-concentration bound) For any D > c, with probability 

at least 1 — 82 , we have: 

X{t) > D. (16) 

Proof. We apply a succession of Doob-type martingale filters to the process under consideration. 
For a given realization of the process, let Xft) = where S'{t) = 5(t) — E(5(r)|5(r — 

l),5(r — 2),..., 5(0)) if X'{t — 1) < cVt^, and 5'(r) = 0, otherwise. In other words, we 
convert our process into a martingale by subtracting expectations of increments, and at the 
same time enclose X'{t) between two “barriers” placed at ±(c\/T^+^). If one of these barriers 
is crossed, X' becomes fixed at this value thereafter. 

For the concentration bound, we start by showing that X'{t) has very small probability of 
crossing one of the barriers. Indeed, for all moments of time t before the barriers are hit we 
have, X{t) = X'(t) + E(5(r)|5(r - 1), 5(r - 2),..., 5(0)), and \X'{t)\ < c^jT^+F We 

immediately have by induction on time that then the conditions |^(t)| < cVt^^ -\- ctT and 
|E(5(r)|5(r — l),5(r — 2),..., 5(0))| < a are satisfied, and so |5(t)| < c and also |5'(t)| < 
2c. For any moment of time t after one of the barriers is hit we have 5'{f) = 0; thus, the 
condition |5'(t)| < 2c holds throughout the time interval t = 1,... ,r. By Azuma’s inequality 
for martingales, we have for any time t: 

Pr[|A'(t)| > cv/r^^] < 2exp = 2e-^^/8. 

Thus, taking the union bound over all moments of time, the bound [|A'(t)| < c\/T^^] holds 
throughout the time interval t = 1,... ,T with probability pi = 1 — = 1 — 

Thus, with probability pi the barriers are not reached, and we have |5'(t) — 5(r)| < a throughout 
the entire time interval [1, T]. Thus, we obtain that the sought concentration bound for process 
X holds with probability pi = 1 — 
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To show the anti-concentration bound, fix D' > c arbitrarily. We will npper-bound the 
probability p 2 that the martingale X' does not hit a barrier located at level D' (i.e., p 2 = 
Pr[Vtg{i ,,, T’} X'{t) < D']). Unlike probability pi, which is very close to 1, we expect p 2 to be 
close to 0. Define martingale X"{t) = where 5"{t) = 8'{t) if X"{t — 1) < D', 

and 6"{t) = 0 otherwise. Observe that, conditioned on the events that process X' does not hit 
either of its barriers at ±{cVt^^) (which holds with probability at least pi) and that process 
X" does not hit its barrier at D' (which holds with probability P 2 ), in a given realization of the 
process, 5"{t) and 8{t) have the same variance. Thns, by (Hi) we can write the following bound 
on the variance of 5"{t) which holds without conditioning: 

Var(<5"(t)) > pla"^, 

where we introduce the notation: P2 = p 2 — (1 — Pi) = P2 — We now show that 

P2 < 16 ^ Suppose, to the contrary, that p^ > 16 ^ • By 

the additivity of variance of a martingale over its elements, we have: 

T 

E(X"2(r)) = Var(X"(T)) = ^ Var(5"(t)) > p^a^T. 

t=i 


On the other hand, since \X"{t)\ < cVt^^ + c < 2cVt^^ by the same bound imposed on 
process X'{t) through its definition, t G {l,...,r}, we also have: 

X"2(r) < 4c^^^+^ 


Since X''‘^{T) is an upper-bounded non-negative random variable, we can apply Markov’s in¬ 
equality to lower-bound its heavy tail: 


Pr 


X"^{T) > 


pla^r 


> - 


1 P*2<y^T _ 1 

2 4 c 2 ri+^ 


= C 


-2 ^—‘Irji — € 


(17) 


and by transforming the expression on the left-hand side, we get: 


Pr 


\X''{T)\ > 2D 




AD' 


\ 1 + 2 ——6 
> C T , 


(18) 


Since the maximum value attained by X"(T) is upper-bounded by D'-|-c < 2D', and by assump 
tion we have P 2 > 16 g- 2 yi- 2 e ^ , we have > 1 and Pr 

0. So, we can drop the absolute value in expression (18): 


X"{T) > 2D' 


Pr 


X"{T) < -2D 




AD' 


1 


* 2 — ‘Irp —e 


> -pla^c-^T 


On the other hand, EX"(r) = 0 and X"{T) < 2D', so by Markov’s inequality: 


Pr 


X"{T) < -2D 


^aVf 


AD' 


< 


< 


AD' 


J- -I- 4£)/ V 


Combining the right-hand sides of expressions (20) and (19), we obtain: 

1 


--pla^c-^T-^ < 


AD' 

^p|o-\/r’ 


(19) 


(20) 
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and subsequently: 


* ^ 
P2 < 


^1024c^ D 


/2 


1/3 


< 16 


D 


/2 


^4 2e 


a contradiction with our assumption. In this way, we have shown: 

.4 ^/2 X 1/3 


1/3 


P2 < 16 


4 ^22^1-2e 


a 




+ glnT-rV8_ 


Now, conditioned on the event that X'{t) does not hit any of the points ±(c\/T'^+^) which 
holds with probability at least pi = 1 — having X'{t) > D' at some time t implies 

X{t) > D' — at > D' — aT. Thns, putting D' = D + aT, we have: 

Pr[Vi.{i,...,TX(t) <D]<P2+p, = 16 ) 

Choosing £ so that = lllnT, we can rewrite the above as: 

121(11+ ar)2ln2r 


+ 2 e 


lnT-TV8 


Pi[Vie{i....,T}^(t) < II] < 16 ( 


CJ’ 


fj^T 


1/3 


+ 


< 


< 82 


c2 (H + aT) In 


aVr 

which completes the proof of our anti-concentration bound 


□ 


We now need to define a meaningfnl random process based on the RPS protocol, for which 


we could take advantage of Lemma |4.2| in the proof of Theorem 4.1 In fact, we will need to 
bound more than one snch process to close the analysis. We first introduce two measures of 
distance of a pair of points x^°'\ in our state space: 


dooix^°‘\x^^'^) = — x^^^lloo = max{|x^“^ 


(“) u(“) 


Xo — X, 


Xq 




Lemma 4.3. Let x(0) be a point in the state space of RPS with C/(x(0)) > —7 Inn for some 
absolute constant 0 < 7 < 1 / 6 , /et x{t) be the random variable representing the point reached 
after following the population protocol for t steps starting from point x(0). Then, for sufficiently 
large n and T < rfl"^, the following claim holds: diy(x(t), x(0)) = 

w.v.h.p. 


Proof. To show the claim, we apply concentration bound (15) to the process X{t) = U{x{t)) — 
C/(x(0)). We have X{t) = X]t=i'^(i ')5 random variable 6{t) given by: 6{t) = U{x{t)) — 
U{x{t — 1)) . Let V = = n~'^. We verify that the first two conditions of 


Lemma 


4.2 


hold for e such that = log^ n, c = a = 


8 

n^v * 


Indeed, suppose that the 


condition from Lemma 14.21 

\U{x{t - 1)) - U{x{0))\ =X{t-l) <cT^-^logn + aT 

is satisfied at some time t — 1, I < t < T. Under this assumption, we have for T < n®/^ and 
sufficiently large n: 


U{x{t-l)) >U(x{0)) - 


AT'^-Hogn 8T 


nv 


n^v 


> 


>U{x{0)) - n-V6+iogiogn+7 > U{xi0)) - In 2, 
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hence the minimum size of a species at time t — 1 is then lower-bounded by: 




Following Q, we then have: 


\6(t)\ < max 
ae{l,2,3} 


In 


na{t “ 1) + 1 “ 1) 


n 


n 


+ In 


na+i(t “ 1) “ 1 _ na+i{t - 1) 


< max I ln(na(t — 1 )) — ln(na(t — 1 ) — 1)1 < max 


n 

2 


n 


< 


< 


< — = c. 


ae{i,2,3}' ' ' " ' ' ' ae{i,2,3} na(t — 1) nv 

Next, we bound the expectation E(5(t) by transforming the equality in ^ at point x{t — 1): 

3 


mt) < 


/ nqjt - 1 ) na+i(f- 1 ) \ 
^Ua+l(t-l) Uait-l) ) ’ 


( 21 ) 




(t-1) 


> -- 


^ \^a+l(^ “ 1) na{t-l) 
4 


> 


n 


minae{i,2,3} na{t - 1) tt?v 


-8 

> = —a. 


( 22 ) 


Thus, we can apply concentration bound (15), obtaining that: 

42^0.5 jQg ^ gj- 


Vte{i,„„T}|tl(x(t))-t/(x(0))| = |X(t)|< 


nv 


+ ^ = 0{T^-^/n^-'^) 


n‘^v 


holds with very high probability 1 — e = 1 — e 


□ 


Lemma 4.4. For a pair of points p,q lying on the same orbit U{p) = U{q) = U < — 6 , let 
i = i{p,q) > 0 denote that smallest time such that for the continuous process (14) originating 
at p we have p{t) = q. If q is separated from p by at most 1/3 of the orbit (t{p,q) < i{p,p)/3), 
then the following relations hold: 


0.05-e^ < dooip,q) < “• 


n 


n 


Proof. The bound doo {p, q) If ^ follows immediately from the observation that for any t > 0 
and infinitesimal time interval dt, we have for the continuous process (14): doo{p{t + dt),p{t)) < 
^. To show the lower bound on doo {p, q) , observe that the linear distance covered in each 
infinitesimal time step can be lower-bounded as follows: 


\\p{t + dt) - p{t )\\2 > dooip{t + dt),p{t)) > - min pa{t)- 

n ae{l,2,3} 




( max Pa(t) — min pa{t))dt > 
ae{l,2,3} ae{l,2,3} U 


^ ( 1 _ eU/3 


M 


dt > — dt, 
on 


where we took into account that = \^a=iPa{t) and that U < — 6 . Denoting by I the length 
of the traversal from p to q along the orbit U, we obtain: 


l > —t 
6n 
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The orbit X 1 X 2 X 3 = is the boundary of a convex subset of the plane xi + X 2 + = 1. 

Moreover, the entire fragment of the considered orbit between points p and q is contained within 
the triangle (p, q, o), where o is the intersection point of the straight lines in the considered plane, 
adjacent to the orbit at points p and q, respectively. By the rotational symmetry of the orbit 
under rotation by 27r/3 in its plane around the point (1/3,1/3,1/3) and the fact that p and q 
are apart from each other by at most 1/3 of the orbit, it follows that /^{poq) > tt/S. By applying 
the law of cosines to triangle (p, q, o) we obtain: 

Up - 0II2 + \\q - 0II2 < 2 ||p- g||2. 


Now, we can write the following bounds: 




d^(P .«) > T||P - «lb £ - »ll= + ll» - -ilW > i/i s 1575; 

which completes the proof. 


e^- 

t > 0.05— t, 
n 


□ 


Lemma 4.5. Let x be a point in the state space and let p he a point with minimum in¬ 
finity norm distance to x from among all points having the same potential as p, i.e., p G 
argmiup/{doo{p', x{ti)) : U{p') = U{p)}. IfU{x) < —3 and doo{x,p) < e^^^\ then 


doc{x,p) < du{x,p). 


Proof. Let d = doo{x,p). Let Xmin = minae{i, 2 , 3 } and let Xmax = max^gii 2 , 3 } We note 
that Xmin < < 0.05 and Xmax > 1/3. Assume first that U{p) > U{x), and let r be the 

point reached from x by moving d individuals from the largest population in x to the smallest 
population in x. By the definition of the potential, we have: 

U{r) > U{x) + In _ In > u{x) +d( —^- —) > U{x) + d. 

Since d = doo{x,p) = doo{x,r), the straight line segment connecting x and r does not intersect 
with the potential orbit U = U{p), hence U{p) > U{r) > U{x) + d, which completes the proof 
for the considered case. 

When U{p) < U{x), we define r by moving d individuals from the smallest population in x 
to the largest population in x; we omit the details of the analogous argument. □ 

Lemma 4.6. Let x(0) be a point in the state space of RPS and let x{f) he the random variable 
representing the point reached after following the population protocol for t steps starting from 
point x(0). Then, for sufficiently large n and any positive integer T, the following claim holds: 

(i) IfT < r?!'^, then: doo{x{t),x{t)) = 0 {T^'^/n), w.v.h.p., where x{f) = {xi{t),X2{t),X3{t)) 

is the following linear approximation to the considered process: 

Xa{t) = Xa(0) ( 1 + - 
\ n 


(Xa+i(0) - Xa+2(0)) , for a ^ {1, 2, 3}. 


Next, consider the process x{t) governed by the continuous RPS dynamics (14) with any starting 
point x(0) such that doo{x{0),x{0)) < A, for some A > 0. Then, the following claims hold: 

(a) If T < , then: yt£{i,...,T} doo{x{t),x{t)) = 0{A-\-T^-^/n), w.v.h.p. 


(Hi) 


If T < and —10 > U{x{0)) > —7 Inn for some absolute constant 0 < 7 < 1/6, then: 
d^{x{t),x{t)) = d{{Tn^~‘^/^ + 1) • (A + T^-^n^-^)), w.v.h.p. 
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(a) 


(b) 



Figure 2: Illustration of the proof of Lemma 
Long-term view (T > 


4.6 


(a) Short-term view (T < and (b) 


(iv) If <T< A < and —10 > U{x{0)) > — 7 Inn for some absolute 

constant 0 < 7 < 1/6, then there exists an integer time step T' = {1 + o(l))T, such that 
doc{x{T'),x{T)) = 0(r°-5n^-^), w.v.h.p. 


Proof. To show Claim (i), we apply the concentration bound ( |15j ) to each of the random pro¬ 
cesses Xa{t) = Xa{t) — Xa{t), for o G {1, 2,3}. We have Xa{t) = ^a('7‘)) where 5a{t) is given 

as: 


5a{t) = Axa{t - 1) - -Xa(0)(Xa+i(0) - Xa+2(0)), 


n 


and Ax a is a random variable with distribution described by (13). We have |(5a(t)| < - and 


1 6 ^ 62 "* 

ESa{t)\ = l)(Xa+l(t-1)-Xa+ 2 (t-1))-a:a(0)(Xa+l(0)-Xa+2(0))| < ^ < (23) 

n n^ 


where we took into account that \xi{t — 1) — Xi(0)| < t/n, for all i G {1, 2, 3} by the definition 
of the population dynamics, which changes the size of each species by at most 1 in each step. 
Thus, applying the concentration bound with c = -, a = and e = log^ n, we have that for 
T < n^/^. 


\Xa{t) - Xa{t)\ = \Xa{t)\ < + ^ = 

holds with very high probability 1 — = 1 — Applying the union bound over 

all a G {1, 2, 3}, we obtain the claim. 

We now proceed to prove Claim (ii), assuming T < (see Fig. [^a)). By Claim (i), 
we have doo{x{t), x{t)) = n) for all t < T, w.v.h.p. It remains to observe that the 
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continuous process is also close to the linear approximation x (compare with (23)): 
dooix{t),x{t)) < 


rt 


1 


- |Xa(r)(Xa+i(T) - Xa+2{T)) - a:a(0 )(Xq+i( 0) - Xa+2(0))| dx < 


< A + max 

ae{l,2,3} n 

/■*!__ 

<A+ max / - |Xa(r)(Xa+i(T) - Xa+ 2 (r)) - Xa(0)(Xa+i(0) - Xa+ 2 ( 0 ))| dr+ 

ae{l,2,3} n 

pi 


- |Xa(0)(Xa+l(0) - Xa+2(0)) - Xa(0 )(Xq+i( 0) - Xa+2(0))| dx < 

ae{i,2,3} Jt-=q n 

6r , /■* 6A , , 6tA , ST^ OTA ^ ^ 

I -^dx + / —dx = A + — + — <A + — + —— = 0(A + r°-Vn). 

T=0 ^ Jt=0 ^ 


+ max 


< A 




n 




n 


Taking into account that dooix(t),x{t)) < doo{x{t), x{t)) + doo{x{t), x{t)), we obtain the claim. 

To prove Claim (hi), we only need to consider the case of T > which is not covered by 
the stronger Claim (ii). Let 0 = to < < • • • < ^/ = ^ be fixed integer moments of time chosen 

so that ti — ti-i < for 1 < t and I = 0{T For 1 < t < /, let pb) denote the 
random variable representing the point on the orbit of the considered continuous dynamics x, 
located closest in the infinity norm to the point x{ti) obtained after ti steps of evolution of the 
discrete dynamics: 

pb) g argmin{doo(p,a;(L)) : U{p) = U(x{0))}, 


and for consistency of notation, let = x(0). By Lemma 4.3, we have w.v.h.p. that for all 


By Lemma 


4.5 


0 < i < 1: du{x{0),x{ti)) = 0{T^-^/n^ '>') and taking into account that d; 7 (x( 0 ),pb)) < A, we 
obtain 

du{x{ti),p^^^) = d{A + T^-^ 
we have doo (x(L),pb)) < du{x{ti),p^^">), thus, 

doo(x(ti),p«) = a(A + T0-Vn'-^). (24) 

Now, for 1 < i < /, define gb) as the point obtained by applying the continuous dynamics (14) 
to point for 5ti = U — L_i steps. Note that = x(ti), but that for z > 1, a similar 

correspondence need not hold precisely. However, since 5ti < we can apply Claim {ii) to 
the discrete dynamics starting at point x(tj_i) and the continuous dynamics starting at point 
p(*-i) and running for 6ti steps. Substituting 0{A + T^/^/n^“'^) for “A” and 0{r?l‘^) for “T” 
in Claim (ii), we have: 


doo{x{ti),q^"'>) = O 


[n 


2/3^0.5 


n 


+ (A + = 0{A + r°-Vn^“^), 


(25) 


with very high probability. Combining the above bound with (24), we obtain: 

doo(p^*\(?®) = o(A + r°-Vn^“^). 

By applying the union bound, the above also holds for all 1 < i < /, w.v.h.p. Now, we introduce 
the following auxiliary notation. For any pair of points p,q, such that U{p) = U{q), we define 
by t{p, q) the smallest value of time t such that either point p is obtained by applying the 
continuous dynamics (14) to starting point q for time t, or vice versa. For the considered set of 
points, the following bound holds: 


i-i 


t(x(r),g(^)) < 


i=l 
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By Lemma |4.4[ we obtain that for a pair of points p, q at distance o(n) on the considered orbit 
— 10 > U = U{x{0)) > — 7 Inn, the following relations hold: 

doc{p,q) = ^{i{p,q)/n^^^) 


and 


Thus, we have: 


doo{p,q) = 0{t{p,q)/n). 


doo{x{T),qd^) = 0{l ■ (A + r°'5n^-^)^^) = 0((rn^-2/3) . (A + T^-V-^)). 


1+7 


n 


Combining the above with bound (25) for point qd\ we get: 


doo(x(r),x(T)) = 0((rn^-2/3) . (A + T°'®nT'-^)) + 0(A + T°'V-^) = 

= d((W2/3) . (A + T^-^n<-^)) 

The above holds w.v.h.p. By stating the obtained claim for all values of T' G [n^/^,T], and 
applying a union bound over all such T', as well as for the case of smaller T' covered by Claim 
(ii), we obtain Claim (iii). 

To show claim (iv), we consider the set of points p{U) which lie at minimum distance 
doo from point x{T), taken over all potential orbits U = t/(x(0)) ± Taking 


into account Lemma 4.3, we will show that the evolution x{t) will intersect with set p{U) 
after T' = (1 ± o(l))T steps; in this way, we will obtain the claim directly from Lemma |4.5[ 
By claim (iii), after T steps, our discrete evolution has reached a point x{T) such that d = 
doc{x{T),x{T)) = d{{Tn^-^/^ + 1) • (A + w.v.h.p. Taking into 

account Lemma |4.4[ we conclude that the intersection of the trajectory with set p{U) took 
place at time T' = T ± 0(dn^+'>') = (1 ± o(l))r. □ 


4.2 The coupling framework 

For a fixed absorbing state r G {(1,0,0), (0,1,0), (0,0,1)}, we denote by Pr{x) the probability 
that the RPS population protocol (13), starting from initial state x, reaches absorbing state 
r. To show that for a pair of states x,y we have Pr{x) ~ Pr{y), we define a coupling on the 
evolution of states x and y over time. Formally, we denote by R the set of possible actions 
which can be taken in any step by the considered population protocol. In the context of RPS, 
we define R = {l,...,n(n — 1)}, and treat elements of R as identifiers of ordered pairs of 
elements of the population. By convention, we will assume that the elements are ordered in 
each step, so that in a state {xi,X 2 , X 3 ), the xi elements belonging to species 1 have the smallest 
identifiers, while the X 3 elements belonging to species 3 have the largest. For any s > 0 and 
sequence S = (5i,..., Sg) G R^, we denote by xjS] the state reached by executing the population 
protocol for s steps, starting from state x, choosing in the i-th step, 1 < i < s, an action of the 
protocol encoded by the value Si G R. 

We will define F to be a random number generator over R if subsequent calls to F return 
elements from R chosen uniformly and independently at random; formally, F = (Fi ,F 2 ,...,), 
where all Fj ~ unif{R) are independent random variables. By a slight abuse of notation, we 
will denote by x[F, s] the random variable in the state space corresponding to the sequence of 
actions x[(Fi,... ,Fs)]. 

We now provide a method for “skipping” some elements returned by a random number 
generator, to create a new random number generator. We recall that if the decision whether or 
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not to skip the i-th element in the sequence returned by a random number generator depends 
only on the values of the previously generated elements (up to the {i — l)-st, then such a gen¬ 
erator remains unbiased. Formally, we call a sequence of functions cj) = (^i, (pi,4>2,(p2^ ■ ■ ■)^ with 
(t>i : —)• {0,1} being measurable (an elimination function) and <1)° : Fi^ ~ unif{R) 

acting as a transformation of random variable F), a resampler on random number genera¬ 
tors. For a random number generator F, we denote by 4‘F = ({(l)F)i, ((l)F) 2 , ■ ■ ■) the se¬ 
quence of random variables with values in R, realized inductively as follows. The first ran¬ 
dom variable {4>F)i takes the value of (j)°^{Fi^), where ii > 0 is the smallest index such that 
(j)i^{Fi, F 2 , ..., Fi^_i) = 1. Next, {(j)F )2 takes the value of where i 2 > h is the smallest 

index larger than ii such that (Fi, F 2 ,..., Fi^^i) = 1, and so on. We note that the resampled 
distribution ^F is also a (uniform, independent) random number generator over R. 

We are now ready to formulate the standard coupling technique in terms of applying resam¬ 
plers to random number generators. 

Proposition 4.7 (Coupling of delayed walks). Let F be a random number generator over R, let 
x,y be two arbitrary starting points in the state space, and let r be an arbitrary absorbing state. 
If there exist two filters fix, fiy on a random number generator such that limt^+ooixlfixFjt]) = 
limt^-^ooiy[fiyF,t]) holds with probability 1 — e, for some e > 0, then \pr{x) — Pr{y)\ < £• 

The validity of the above proposition follows from the fact that each of the marginals fixF, 
fiyF represents an unbiased evolution of the system. Informally, we will apply the above tech¬ 
nique as follows. We will sample numbers from R from a random number generator. Based 
on all the numbers sampled so far, we will decide if the next number to be sampled should be 
applied only in the evolution of the process originating from x, in the evolution of the process 
originating from y, or in both those processes. (If only one process undergoes evolution in the 
given step, the other process can be thought of as delayed in this step). In the following, we 
will consider the walks in the state space originating from x and y, and we will execute the 
following types of phases: 

• One of the walks progresses until a given termination condition is met, while the other 
walk is delayed. 

• Both walks progress simultaneously in a given step t, with one walk following action 
fix t(Ft) and the other following action fi° fiFt) in this step. 

We are now ready to apply the coupling technique to obtain the main technical result of this 
section. 

Lemma 4.8. Fix 7 = 0.005 and e = 0.05. Let x(0) = (xi(0), X 2 ( 0 ), X 3 ( 0 )) be arbitrarily fixed 
with —12 > t/(x(0)) > — 7 Inn, and letyifif) = (^ 3 ( 0 ), xi(0), ^ 2 ( 0 )). Then, there exist a coupling 
of X and y which leads to the same absorbing state with probability 1 — 0(n“^). 

Proof. The proof proceeds by a coupling of walks originating from x and y in the above-described 
framework. By a slight abuse of notation, we will denote by x{t) and y{t) the position of each of 
the two walks in the state space after t steps (i.e., after t applications of the random generator 
F), which may include steps in which a given walk is delayed. Our goal is to make points 
x{t) and y{t) coalesce within a small number of steps T, i.e., to obtain x{T) = y{T) with 
probability 1 — where T <C Consequently, taking into account Lemma 

we will silently assume that the bounds —(1 -|- o(l))12 > U{x{t)) > —(1 -|- o(l)) 7 lnn and 
— (1 -|- o(l))12 > U{y{t)) > —(1 -|- o(l)) 7 lnn are preserved throughout the coupling. 

The coupling proceeds in five phases, illustrated in Fig. We start by providing a high level 
overview, thinking for now of the potential ?7(x(0)) = 0(1) to simplify calculations. In Phase 1, 


4.3 
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point X approaches point y, which is stopped. In this way, the infinity norm distance between 
X and y is reduced, at the cost of increasing the du distance to slightly over Next, in 

Phase 2 we run both walks independently, so that the distance djj in time follows a random 
evolution resembling a random walk, and after slightly more than n steps, the value djj = 0 
is hit with sufficiently high probability. Whereas the walks are now orthogonally aligned, we 
also need to align them along the orbit, since we may at this point have them at a distance of 
doc > apart. By allowing the slower walk to catch up, we reduce doc to slightly more 

than at the cost of increasing djj to a similar value. In this way, we have decreased the 

norm in both distances (from about n~^'^ to about We iterate Phase 2, reducing each 

time the distance between the two walks in both norms, up to an iteration in which the size 
of the populations in x and y differ by an arbitrarily small polynomial in n. (We remark that 
multiple iterations of Phase 2 may also be replaced by a path-coupling argument of the type 
used in [18], but this does not necessarily simplify the proof.) At this point, only a very small 
number of time steps remains until coalescence. We first align the two states by evolving one of 
them until the size of one of the three populations is identical for x and y at the end of Phase 
3, and then perform a standard coupling by correlating the evolution of x and y in Phase 4, so 
as to make the sizes of the other two populations meet for x and y, while maintaining equality 
on the size of the population coalesced in Phase 3. Finally, after the coupling is achieved, we 
evolve the coalesced state into an absorbing state in Phase 5. 


Phase 1: 


.Y = X(0) 


4'i) 



d„Wr,), )<(;,)) = b(« ■»■=+») 
(x(r,). y(t,)) = 0(n -»5+i.5,) 


Phase 2: 

d^(x(t,,,).y(t,,0)<D/2 

yd-n)) 

U= U{x{t ,')) » U(y(t,')) _ ,/ ' 4f, ’) = 

d„(x(t,),y(ti’)) = di’ / 


duix(t,), y(ti)) <D 
d„(x{t-),y(ti))<D 




Phase 1. In the first ty steps, for all t < ty the walk x{t) progresses while the walk 
y{t) is delayed. We choose the duration of the phase so that x{ti) and y(ti) as close to 
each other in the infinity norm as possible, after walk x{t) has traversed approximately 
1/3 of its orbit around the state space. Formally, let T be the number of steps of the 


continuous evolution which transforms point x(0) into point y(0); we have by Lemma 4.4 
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that ti = 0{nle^^^'>) = Next, let ti be chosen as the time T' = (1 + o(l))T 

which follows from Lemma |4.6[ iv), i.e., the time such that the discrete process starting 
fromx(O) after T' steps satisfies doo{y{0),x{T')) = w.v. h.p 


4.3 


Moreover, we also have du{y{0), x{T')) = 0{T^’^n^~^) = by Lemma 

w.v.h.p. Since walk x progresses for ti = T' steps and walk y is delayed throughout 
{y{ti) = y(0)), at the end of this phase, we obtain du{y{ti), x{ti)) = and 

doo{y{ti),x{ti)) = w.v.h.p. 

Phase 2 consists of a certain number (logarithmic in n) of iterations. We start iteration i at 
time ti with du{y{ti),x{ti)) < D and doo{y{ti),x{ti)) < D, where D < fi-0-5+i.5'y_ each 
iteration, we start by running both walks in parallel until a time at which the two evolu¬ 
tions are located on the same potential orbit (up to integer rounding): d[/(y(t'),x(t')) = 
0{rP~^). We introduce the following notation: let r{t) = U{x{ti + t)) — U{y{ti + t)) 
and consider the process X{t) = r{t) — r(0). We can use the following sum representa¬ 
tion: X{t) = Y1 t=i with the increment 5{t) given as 6{t) = r(r) — r(r — 1). Notice 
that |r(0)| = difiy{ti), x{ti)) = C>(n“*). We now apply the anticoncentration bound of 
Lemma 4.2 to process X{t) with |r(0)| = doo{y{ti), x{ti)) < D to bound the probability 


of r{t) having opposite sign to r( 0 ), for some t G [ 0 ,T], where the length of the inter¬ 
val is suitably chosen (T = D"^). Without loss of generality of the argument, let 

r( 0 ) < 0 ; then, we and ask about the probability of the event r(t) > 0 , which is equivalent 
to X{t) = r{t) — r(0) > —r(0) = D occurring. (If r(0) > 0, we apply the anticoncentration 
bound to process —X instead.) Now, by analyzing the change of potential [/ in a step 


of the discrete dynamics (13), for the different pairs of possible agents, we obtain that 


Lemma 4.2 is applicable to process X with the following parameters (compare with the 


proof of Lemma 4.3 for a related derivation): 


c = 0 (n-i+T') 
a = 0 (n- 2 +T') 

a = fi(n-i-°-^T') 

T = 

where e is an absolute constant belonging to the range 0 < e < 0.25 — 4 . 757 . 


Then, we can bound the probability of failure for equation (16) as follows: 

' {D + aT) In r\ ~(( D + n'^-^T 
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CJ 


Vr 


- 


= o 


(^-1-0.57)2 ^_i_o,57^ 


2/3N 


n2/3 


= a j^n2/3+77/3^ + ^-2/3+37^1/3j ^ 

At this point, the time shift of the two processes can be bounded as: 

d' = doo(x(t'), ?/(t')) = + 1)-{D + = 

= a((Z)2n^/3+87+£ + l)Dn^-57+0.5e)^ 


Now, we proceed from time to time tj+i by aligning the two walks. Without loss of 
generality, suppose that x(t() is lagging behind along its trajectory with respect to y(t() 
(i.e., that a continuous evolution from point x(t'j) reduces its distance to point y(t()). 
We now continue the evolution of point x(t') until it becomes close to point y(t(), which 
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remains motionless. By Lemma |4.6| (iv), we then have: 


doo{x{ti+i),y{ti+i)) = O 


~ / {tj+i - t[) 


./nO.5 




n 


1-7 


= o 




n 


1-7 


For D > 77 - 2 / 3 - 47 - 0 .further bound this as: 

(ioo(a:(L+l),2/(ti+l)) = O(Dn2/3+47+0.5e(^-0.5+1.57)0.5^-0.5+3.757+0.25E^ ^ 

= a(Z/n-Vi2+8.57+o.75e) < ^/2 = d^{x{U),y{U))/2, 


where the final inequality holds when we set 7 = 0.005, e = 0.05, and sufficiently large n. 
For D < 77 - 2 / 3 - 47 - 0 . 56 ^ apply the following bound: 

d^{x{ti+i),y{ti+i)) = < D/2 = d^{x{ti),y{ti))/2, 


where the final inequality holds for sufficiently large n when D = oj{n 1 + 7 - 57 + 0 . 

We also recall that by Lemma 4.6 (iv), we can bound (if/(x(tj+i), y(tj+i)) similarly to 
doo{x{ti+i)-,y{ti+i)), obtaining (i[/(x(L+i),y(L+i)) < D/2 under the same assumptions. 


Thus, in every iteration of the coupling phase, starting from a pair of points {x(ti),y{ti)) 
such that D = ^ with probability 1 — 0{n~^) we reach in 

steps a new pair of points (x(tj+i), i/(L+i)) such that doo(a;(ti+i), 2 /(ti+i)) < D/2 and 
djj{x{tiJ^i),y{tiJ^i)) < D/2. The next iteration then starts. The phase is completed after 
less than s iterations, where s = O(logn), with success probability 1 — 0{n~^). For the 
chosen values of constants 7 and e, at the end of the phase, we obtain that D < 
where p = 0.07. 


• Phased. We start this phase from a pair of points (x(ts), y (is)), such that (ioo(a;(ts)) 2 /(is)) < 

^-i+P^ Our goal is to reach in a small number of steps a pair of points {x{t'g), y{t'g)) such 
that one of the species has populations of exactly the same size in x(t'^) and yit^)), with¬ 
out increasing doo{x{t'g),y{t'g)) too much. Let a be the species such that the value of 
Xa+i(ts) — Xa+ 2 {ts) IS maximized over a G {1, 2, 3} (a represents the species which is most 
likely to grow quickly in the next few steps). We then continue to evolve that of the walks 
x{ts),y{ts), which has a smaller size of population a, while the other walk remains paused 
throughout this phase. The phase ends at a time t^, such that Xa{t'g) = yait's)- restrict 

ourselves to a consideration of the case when yaits) < Xaits) (walk y progresses, while x 
is paused). Then, at each of the considered steps -|- t, for 0 < t < we have: 

E(ya(ts + t+l) - yaits + t)) = + ^) {y^_^_i[ts + t) - ya+2its + t)) > 

n 

> ^^^^^iya+lits) - ya+2its)) “ ^ (Xa +1 (ts) - Xa+2its) “ 2n"^+^) - ^ = 

= L?(n-^-^). 


The change of ya in each step of the walk is bounded by 1/n. Applying Azuma’s inequality, 
we obtain that w.v.h.p. the deviation of ya from its expectation is bounded by Oi^/t/n). 
Thus, w.v.h.p., for t = crP~^P for a sufficiently large constant c, we have: 

yaits + t)= yaits) + n(n“^“'7cn'7+^ > Paits) + doo(a:(t<;), y(t*)) > Xaits)- 

Thus, the phase is completed within OirP~^P) steps w.v.h.p. At the end of the phase, we 
have Xait's) = yait's), and doo(a:(t'J, y(t'J) = 0(n“^+7'+^). 
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• Phase 4- In this penultimate phase, we allow both walks to progress simultaneously in each 
time step starting from step t'g until they coalesce, under the following coupling. At time 
step tg, we arrange the elements of the populations of x{t) and y{t) in linear order, from 1 to 
n, putting those from population 1 leftmost and those from population 3 rightmost. Every 
step of a coupling corresponds to drawing a uniformly random pair (i,j) G {1, • • • ,n.}^ 
from our random number generator, which corresponds to an interaction in which the 
i-th and j-th agents in x{t) and y{t) interact with each other (the roles of i and j as 
predator and prey will be defined later). We label the species of the agents as follows 
s : {1,..., n} —)■ {—1,1, 2, 3}, where s(i) = 1, 2, or 3 if both of the agents located at the i- 
th position (counting from the left) in x{t'g) and y{tg) belong to the same respective species, 
and s{i) = —1 otherwise. We remark that by the condition doo(,x{ts),y{tg)) = 

we have that |{i : s{i) = —1}| = Note that the labels s are defined at time 

t'g and never change afterwards. 

The coupling process will be required to finish within T = time steps of Phase 

4. We will only consider the success of the coupling under the event that the generator 
never makes any agent participate in more than one interaction throughout Phase 4. 
(By a birthday paradox computation, this event holds with probability 1 — 0{n~^).) 
We will also condition the success of our coupling on the event that no agent i with 
s(i) = — 1 is chosen to interact throughout the phase (this event holds with probability 
1 — 0(Tn“^'’''>'^^) > 1 — 0{n~^)). Under these conditions, we define the interactions for a 
drawn random pair (i, j) in step t of Phase 4 as follows (independently of the step number, 
until the termination condition x{t) = y{t) is reached): 

— If {s(i), s{j)} = {a + 1, a + 2}, then we perform the interaction i ^ j with probability 
0.5 and the interaction j ^ i with probability 0.5, chosen independently for processes 
x{t) and y(t). We recall that species a was defined in Phase 3 so that Xa{t'g) = ya{t'g)- 

— If {s{i),s{j)} 7 ^ {a + l,a + 2}, then we perform the interaction i ^ j for both 
processes. 

Notice that since we take into account only the interaction of agents having a positive 
value of s{i), and we never allow any agent to interact more than once, all interactions 
performed by agents from population a will have the same outcome for both processes 
X and y. Thus, we have Xa{t) = ya{t) throughout Phase 4, and it suffices to show that 
a similar equality will hold for the other populations. Equivalently, we will require that 
Z{t) = X{t) — Y{t) = 0, where the processes X and Y are defined as X = Xa+i{t) — Xa+ 2 {t) 
and Y = ya+i{t) — ya+ 2 {t)- Let p = Observe that X 

and Y are walk processes along the real line, such that in each step we have Pr[X(t + 
1) — X{t) = 1] = p and Pr[X(t + 1) — X(t) = 0] = 1 — p. Likewise, we have independently 
Pr[y {t + 1) — Y{t) = 1] = p and Pr [U (t + 1) — T (t) = 0] = l—p. (Note that probability p 
does not change over time.) Thus, we have that process Z follows a lazy random walk on 
the integer axis, with Pi[Z{t + 1) — Z{t) = 1] = Pr[Z(t + 1) — Z{t) = —1] = 2p(l — p) and 
Pr[y(t + 1) — Z{t) = 0] = 1 — 2p(l — p). Since Z{t'g) = 0{ndoo{x{t'g),y{t'g)) = by 

the standard properties of hitting times of the random walk, we have that Z{t'g + t) = 0 is 
achieved within time t = (^i 2 p(i-p) (^^'*~^)^) = w.v.h.p. Noting that t < T = 

^ 0 . 5 -e^ we have that Phase 4 is successfully completed. Overall, at some time tj = t'g + t, 
we have coalesced to a point x{tf) = y{tf) with probability at least 1 — 0{n~^). 

• Phase 5. After the two processes have coalesced at the end of Phase 4, we allow them to 
progress under a complete coupling until they reach the same absorbing state. 
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□ 


Lemma 4.8 almost completes the proof of Theorem 4.1 We only need to note that the 


assumption on potential 17(x(0)) made in Lemma 4.8 can be applied to any point x meeting 
the assumptions of Theorem |4.1[ The claim of the Theorem clearly holds for all points x such 
that —12 > U{x) > — 7 Inn. Note, however, that the given upper bound on U{x) can be 
dropped: for any point x having potential too large, we can evolve it arbitrarily until a point 
with potential at most —12 is reached, and then apply the claim of the Theorem. Finally, we 


note that the required lower bound on U{x) follows from the assumptions made in Theorem 4.1 


if Xa > for all a £ {1,2,3}, then U{x) > 21n(n“°'™^) + In ^ for sufficiently 

large n. 

We close the paper by remarking about the rate of convergence of RPS to an absorbing state. 
In the RPS protocol, as soon as one of the populations becomes empty, Xa = 0, it is immediate to 
show that species 0 + 1 , without having any natural predators, will eliminate all representatives 
of species a + 1 , and the system will stabilize to the absorbing state: Xa+i = 1 , Xq = Xa +2 = 0 
within O(nlogn) steps. To bound the time until the first population is eliminated, we can 
perform a special case of the analysis from the proof of Theorem |2.1[ obtaining an overall 
bound of 0{n^) on convergence time. This corresponds to the quantitative results obtained in 
the stochastic noise model presented in MM- 
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